Let's go lab: a platform for evaluation of spoken dialog systems with real world users
نویسندگان
چکیده
This short paper is intended to advertise Let’s Go Lab, a platform for the evaluation of spoken dialog research. Unlike other dialog platforms, in addition to example dialog data and a portable software system, Let’s Go Lab affords evaluation with real users. Let’s Go has served the Pittsburgh public with bus schedule information since 2005, answering more than 52,000 calls to date.
منابع مشابه
Building Practical Spoken Dialog Systems
This tutorial will give a practical description of the free software Carnegie Mellon Olympus 2 Spoken Dialog Architecture. Building real working dialog systems that are robust enough for the general public to use is difficult. Most frequently, the functionality of the conversations is severely limited down to simple question-answer pairs. While offthe-shelf toolkits help the development of such...
متن کاملLexical entrainment of real users in the let's go spoken dialog system
This paper examines the lexical entrainment of real users in the Let’s Go spoken dialog system. First it presents a study of the presence of entrainment in a year of human-transcribed dialogs, by using a linear regression model, and concludes that users adapt their vocabulary to the system’s. This is followed by a study of the effect of changing the system vocabulary on the distribution of word...
متن کاملLet's go public! taking a spoken dialog system to the real world
In this paper, we describe how a research spoken dialog system was made available to the general public. The Let’s Go Public spoken dialog system provides bus schedule information to the Pittsburgh population during off-peak times. This paper describes the changes necessary to make the system usable for the general public and presents analysis of the calls and strategies we have used to ensure ...
متن کاملComparing Spoken Dialog Corpora Collected with Recruited Subjects versus Real Users
Empirical spoken dialog research often involves the collection and analysis of a dialog corpus. However, it is not well understood whether and how a corpus of dialogs collected using recruited subjects differs from a corpus of dialogs obtained from real users. In this paper we use Let’s Go Lab, a platform for experimenting with a deployed spoken dialog bus information system, to address this qu...
متن کاملLET's GO: improving spoken dialog systems for the elderly and non-natives
With the recent improvements in speech technology, it is now possible to build spoken dialog systems that basically work. However, such systems are designed and tailored for the general population. When users come from less general sections of the population, such as the elderly and non-native speakers of English, the accuracy of dialog systems degrades. This paper describes Let’s Go, a dialog ...
متن کامل